Critical Echo State Networks that Anticipate Input using Adaptive Transfer Functions
نویسنده
چکیده
The paper investigates a new type of truly critical echo state networks where individual transfer functions for every neuron can be modified to anticipate the expected next input. Deviations from expected input are only forgotten very slowly in power law fashion. The paper outlines the theory, numerically analyzes a one neuron model network and finally discusses technical and also biological implications of this type of approach.
منابع مشابه
Echo State Condition at the Critical Point
Recurrent networks that have transfer functions that fulfill the Lipschitz continuity with L = 1, may be echo state networks if certain limitations on the recurrent connectivity are applied. Initially it has been shown that it is sufficient if the largest singular value of the recurrent connectivity S is smaller than 1. The main achievement of this paper is a proof under which conditions the ne...
متن کاملPredicting the Coefficients of Antoine Equation Using the Artificial Neural Network (TECHNICAL NOTE)
Neural network is one of the new soft computing methods commonly used for prediction of the thermodynamic properties of pure fluids and mixtures. In this study, we have used this soft computing method to predict the coefficients of the Antoine vapor pressure equation. Three transfer functions of tan-sigmoid (tansig), log-sigmoid (logsig), and linear were used to evaluate the performance of diff...
متن کاملForecasting Industrial Production in Iran: A Comparative Study of Artificial Neural Networks and Adaptive Nero-Fuzzy Inference System
Forecasting industrial production is essential for efficient planning by managers. Although there are many statistical and mathematical methods for prediction, the use of intelligent algorithms with desirable features has made significant progress in recent years. The current study compared the accuracy of the Artificial Neural Networks (ANN) and Adaptive Nero-Fuzzy Inference System (ANFIS) app...
متن کاملEcho State networks and Neural network Ensembles to predict Sunspots activity
Echo state networks (ESN) and ensembles of neural networks are developed for the prediction of the monthly sunspots series. Through numerical evaluation on this benchmark data set it has been shown that the feedback ESN models outperform feedforward MLP. Furthermore, it is shown that median fusion lead to robust predictors, and even can improve the prediction accuracy of the best individual pre...
متن کاملArrival probability in the stochastic networks with an established discrete time Markov chain
The probable lack of some arcs and nodes in the stochastic networks is considered in this paper, and its effect is shown as the arrival probability from a given source node to a given sink node. A discrete time Markov chain with an absorbing state is established in a directed acyclic network. Then, the probability of transition from the initial state to the absorbing state is computed. It is as...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1606.03674 شماره
صفحات -
تاریخ انتشار 2016